Learning Objectives

After completing this lesson, you’ll be able to:

Video

Data Integration Challenge

Jennifer

Jennifer has a problem. She works as a GIS Specialist for a city government. Her organization is facing a significant challenge: how can they get raw crime data provided by their police department into a GIS?

Let’s find out how she can solve this data integration problem with FME through the steps of connecttransform, and automate.

Connect

The crime data is in a MySQL database and needs to be loaded into an Esri ArcGIS geodatabase for both public and internal web mapping applications. The crime data does not have a coordinate system or any other spatial data associated with it except street addresses.

Note

coordinate system uses one or more numbers, or coordinates, to uniquely determine the position of a point or other elements on the surface of the Earth.

Learn More

Jennifer uses the desktop authoring software FME Desktop to connect the police crime data to a geodatabase. She does this by adding a MariaDB (MySQL) Reader and an Esri ArcGIS Geodatabase Writer, then clicking and dragging to connect them. Using FME, Jennifer doesn’t have to write a single line of code.

Connecting data

Transform

Next, Jennifer uses FME Desktop to author a workflow, which we call a workspace, that accomplishes multiple goals:

Using objects called transformers, Jennifer is able to restructure her data to fit the needs of her destination system.

Note

Schema: a formal definition of a dataset’s structure, including table names, attribute names, and attribute data types (e.g. text, integer, float). You might also hear this called a data model.

Learn More

Using a transformer

Automate

If Jennifer only needs to integrate this data once, she can run her workspace in FME Desktop and she’s done. However, if she needs to load data on a continuous basis, she can publish it to FME Server. With FME Server she can run her workspace automatically whenever new data becomes available. She also sets up email notifications to be sent to the FME Server Administrator when the workspace succeeds or fails.

Publishing to FME Server

Note

If Jennifer didn’t want to install and configure FME Server on her own, she could use FME Cloud instead. FME Cloud is a deployment option for FME Server that is hosted by Safe Software.